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Abstract. This paper is devoted to the nonparametric estimation of the jump rate and 
the cumulative rate for a general class of non-homogeneous marked renewal processes, 
defined on a separable metric space. In our framework, the estimation needs only one 
observation of the process within a long time. Our approach is based on a generalization 
of the multiplicative intensity model, introduced by Aalen in the seventies. We provide 
consistent estimators of these two functions, under some assumptions related to the 
ergodicity of an embedded chain and the characteristics of the process. The paper is 
illustrated by a numerical example. 



1. Introduction 

The purpose of this paper is to develop a nonparametric method for estimating the 
jump rate of a non-homogeneous marked renewal process, when only one observation of 
the process within a long time is available. Our estimation procedure is premised on a 
generalization of the well-known multiplicative intensity model, investigated by Aalen in 
[2,3]. 

We introduce a general class of non-homogeneous marked renewal processes (NHMRP's), 
defined on an open subset of a separable metric space. The motion of the process depends 
on three characteristics namely the jump rate A, which specifies the interarrival times, the 
transition kernel Q, and a function t*, which plays the role of a deterministic censorship de- 
pending on the state of the process. In this framework, the jump rate A is a function of two 
variables: a spatial mark and time. Here, our aim is to propose a nonparametric method 
for estimating both the jump rate A and the cumulative rate from only one observation of 
the process within a long time interval. In addition, the class of non-homogeneous marked 
renewal processes which we consider may be related to particular piecewise-deterministic 
Markov processes (PDMP's, see the book [13]), whose transition kernel does not depend on 
time. This paper is also a keystone of [6], in which we provide a consistent nonparametric 
estimator of the conditional density associated to the jump rate of a general PDMP. 

Aalen suggested in the middle of the seventies the famous multiplicative intensity model 
(see his PhD thesis [1], or [2, 3]). In this work [1, 2, 3], it is assumed that the intensity of 
the underlying counting process N can be written as the product of a predictable process Y 
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and a deterministic function A, called jump rate or hazard rate. In this framework, the so- 
called Nelson- Aalen estimator provides an estimate of the cumulative rate A(t) = X(s)ds. 
Ramlau-Hansen suggested a few years later, in [23], a nonparametric method for estimating 
directly the rate A, by smoothing the Nelson- Aalen estimator by kernel methods. 

A large number of estimation problems in survival analysis or in statistics of processes 
are related to counting processes depending on a spatial variable. This one may be seen as 
a mark or as a covariate. In this context, Aalen's estimator is proved to be a very popular 
and powerful method, since the multiplicative assumption is satisfied in a large variety of 
applications (see for instance [5]). In particular, one can apply the Nelson-Aalen approach 
for estimating the jump rate of a marked counting process, whose state space is finite, from 
a large number of independent observations. More recently in 2011, Comte et al. proposed 
in [10] an adaptive method for estimating the jump rate of a marker-dependent counting 
process, under the multiplicative assumption. 

There exists an extensive literature on nonparametric and semiparametric estimation 
methods when the spatial mark belongs to a continuous state space. However, we do not 
attempt to present an exhaustive survey on this topic. A significant list of references on 
this research field can be found in [4, 5, 16, 20] and the references therein. In particular, 
McKeague and Utikal were interested in [21] in the estimation of the jump rate when 
the covariate takes its values in [0,1]. Their approach is based on smoothing a Nelson- 
Aalen type estimator both in spatial and time directions. In particular, they prove the 
consistency of their estimator. Li and Doss chose another approach, based on a local linear 
fit in the spatial direction (see [19]). They extended McKeague and Utikal's work for 
the multidimensional case, and proved weak convergence results. One may also refer to 
the papers written by Utikal [25, 26] about jump rate estimation for two special classes 
of marked counting processes, under some continuous-time martingale assumptions. The 
Euclidean structure of the covariate state space is a keystone of the papers mentioned above. 
At the same time, nonparametric approaches have also been considered by Beran in [8], 
Stute in [24] and Dabrowska in [12], but for independent observations. Semiparametric 
methods have also been considered by many authors, beginning with Cox in [11]. The 
interested reader may consult the book [5] and the references therein for a complete review 
of the literature on these models. 

In many aspects, our approach and the results mentioned above are different and com- 
plementary. These differences may be briefly described as follows. Our paper is based 
on a generalization of the multiplicative intensity model, involving a discretization of the 
state space, and, as a consequence, an approximation of the functions of interest. Indeed, 
we do not impose any conditions on the state space, such as to be Euclidean. This no- 
tably excludes the methods investigated by McKeague and Utikal, Li and Doss, or Utikal. 
Furthermore, these authors consider some assumptions about both continuous-time mar- 
tingale properties and the asymptotic behavior of Y. From a practical point of view, this 
kind of assumption is not completely satisfactory due to the fact that these conditions 
may be difficult to check, especially in our case. On our side, we overcome this difficulty 
by providing tractable conditions, directly related to the primitive data of the process, to 
ensure the consistency of our estimator. 

The present paper is divided into two parts. In the first one, we consider that the 
transition kernel only charges a finite set of points. It amounts to considering the state 
space is a discrete one. In this context, Theorem 3.1 states that the multiplicative model is 
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satisfied. In the second part, we assume that the kernel Q is diffuse, that is to say, it does 
not charge singletons. If the Zi's denote the marks of the underlying process, for any x and 
i, the indicator function l{Zi=x} i s almost surely null. This rules out the method developed 
in the discrete case. Our procedure relies on a partition of the state space, labeled 
In this context, it appears intuitive to consider the counting process 

n-1 

N n (A k , t) = l {ZieAfc }l{5 l+1 <<}' 
i=0 

where the SVs denote the interarrival times. Although Aalen's multiplicative model does 
not hold for this counting process, the stochastic intensity of N n (A k ,t) is almost surely 
equivalent to the product Y n (A k , t)l(Af., t) (see Proposition 4.12), where 1(A)-, t) is an 
approximation of the jump rate X(x,t), for x 6 Af,, and 

n-1 

Y n (A k ,t) = X] 1 {^eA fc }l{s l+1 >t}- 

8=0 

In this context, it is natural to introduce the following processes, 

L n (A k ,t)= [ Y n (A k ,s) + dN n (A k ,s), 
Jo 

where Y n (A k ,t) + is the generalized inverse of Y n (A k ,t), and 

L *n( A k,t) = / l(A k ,s)l {Yn (A k ,s)>o}<is, 
Jo 

In Aalen's papers, the difference L n (A k ,t) — L^(A k ,t) is a continuous-time martingale, 
whereas on our part, it is not the case since there exists an extra-term a n (t), which 
vanishes when n goes to infinity. Intuitively, this means that the multiplicative model 
asymptotically makes sense. Referring to both Lenglart's inequality and the asymptotic 
behavior of the extra-term a n (t), we prove that L n (A k ,t) is a consistent estimator of 
L(A k ,t) = J l(A k ,s)ds (see Proposition 4.16). We deduce from this a consistent estima- 
tor of the cumulative rate A(x,t) = J ' A(x, s)ds (see Theorem 4.21), since L{A k ,t) and 
A(x, t) are close for x £ A k (see Lemma 4.18). Next, we focus on smoothing this estimator 
by kernel methods in order to suggest a consistent estimator of l{A k ,t) (see Proposition 

4.23) and, therefore, of X(x,t) (see Theorem 4.24). An inherent difficulty throughout this 
paper is related to the presence of the deterministic censorship. 

The paper is organized in the following way. We first give, in Section 2, the precise def- 
inition of the class of non-homogeneous marked renewal processes which we are interested 
in, and we provide an example of application in reliability. We state also some technical 
results about continuous-time martingales and conditional independences. Section 3 is 
devoted to the discrete case, where we consider that the transition kernel Q only charges 
a finite number of points. The main contribution of the paper lies in Section 4, in which 
we do not impose any conditions on the state space. In this part, we provide consistent 
estimators of the cumulative rate (see Theorem 4.21) and the jump rate (see Theorem 

4.24) . Finally in Section 5, we present a numerical example to illustrate the good behavior 
of our estimators on finite sample size. 
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2. Definition and first results 

Let E be an open subset of a separable metric space (£,d). One considers a Markov 
chain (Z n ) n >o on (E,B(E)), defined on a probability space (Q,A,P Uo )- The distribution 
of Zq is assumed to be vq. An equivalent formulation (see for instance Theorem 2.4.3 of 
[7]) is given by, 

(1) Vn > 1, Z n = l/}(Z n -i,£ n -i), 

where ip is a measurable function, and (e n ) n >o is a sequence of independent and identically 
distributed random variables. Let A : E x R + — > R + be a measurable function and $ a 
deterministic flow on E. One may associate to $ the deterministic exit time from E: 

(2) V£ G E, t*(0 = inf {t > : t) G 

One remarks that the function t* may take the value +oo. Now, one defines a sequence 
(<SVi)n>i on (R+,jB(R+)). The distribution of Si is given from its survival function, 

Vt>0, P U0 (Si >t\{Zi :i>0}) = P U0 (Sx>t\Z Q ) 

= exp (~ J \(Z ,s)ds^J l{o<t<t*(z )}- 

For each integer n > 2, the distribution of S* n satisfies, for any t > 0, 

(3) P M) (5 n >t|{Z i :i>0},5i,... > S n — i) — P i/0 (S' ?1 > t\Z n —i) 

= exp^-^ A(Z n _i,s)ds^ l{o<i<i*(z n _!)}- 

Hence, there exist a function <p and a sequence of independent and identically distributed 
random variables (5 n ) n >o, which is independent of the sequence (e n ) n >o, such that, 

Vn > 1, S n = (p(Z n -i,S n -i). 

One assumes that the two sequences (e n )n>o anci (<^n)n>o are independent of Zq. The 
underlying non-homogeneous renewal process {Xt)t>o is defined by, 

Vt>0, X t = Z n if S + • • • + S n < t < S + ■ ■ ■ + 

with the usual convention Sq = 0. 

We recall that we are interested here in the nonparametric estimation of the jump rate A, 
from one observation of the embedded chain (Z n , S n ) n >o. This class of non-homogeneous 
renewal models may be related to PDMP's, for which the transition kernel Q does not 
depend on time. Hence, the estimation method developed in this paper is very useful in 
order to estimate the conditional distribution of the interarrival times for PDMP's (see [6]). 
Nevertheless, providing a method for estimating the jump rate for this class of stochastic 
models has an intrinsic interest. In the following, we present an example in reliability of 
non-homogeneous marked renewal process satisfying the model mentioned above. 

Let us consider a machine, whose production configuration takes its values in an open 
subset of R d . The dynamic of the regime is assumed to be a non-homogeneous renewal 
process: the state is piecewise-constant until a failure spontaneously occurs. One natu- 
rally considers that the failure rate depends on the production regime. When the machine 
breaks down, the repair occurs instantaneously, and the machine configuration is randomly 
changed, according to a transition kernel Q depending only on the previous working state. 
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In addition, one may consider that there exists a deterministic period of inspection, de- 
pending on the production configuration too. The inspection is instantaneous and the next 
regime changes according to the kernel Q. The estimation of the failure rate from only one 
observation of the regime state within a long time may bring some informations about the 
behavior of the production machine. The main benefit of this approach is as follows: the 
estimation does not need the observation of a great number of similar machines. 

One may associate to the jump rate A, the cumulative rate, the survival function and the 
probability density function, which are related to it. The conditional density / satisfies, 

(4) V£ G E, Vt> 0, /(£, t) = A(£, t) exp (- J* A(£, a )ds\ . 

The cumulative rate A is defined by, 



(5) 



V£ £E,Vt> 0, A(£,t) = f 

Jo 



Finally, the conditional survival function is denoted by G. 



(6) 



V£ £E,Vt> 0, G(£, t) = exp 



o 



For each n > 1, Q n denotes the cr-field generated by the n first Z^s, 
(7) Q n = a(Z , . . . , Z n ^i). 

For each integer i, the one-jump counting process N l+1 is given for any t > 0, by 

N l+ \t) = l {Si+1 < t} , 

and (J~t +1 )t>o denotes the associated filtration. In this section, we shall prove two results: 
the first one is related to two conditional independence properties; the second one deals 
with the continuous-time martingale associated to the counting process N t+1 in a special 
filtration. 

Proposition 2.1. Let n be an integer and 1 < i < n. For each integer j ^ i, let tj > 

and t > 0. Then, we have 



3^ 



Furthermore, we deduce from Proposition 6.8 of 
s <t, 0<i<n — 1, 



and J^l _L Q n . 

this immediate corollary: for any 



v n 



_L 



i+l 



and 



H +l -L Qn- 



Proof. We state the first conditional independence. Let us consider h\ , 
measurable functions mapping from R + to R. From (3), we deduce 

E„ [h 1 (s 1 )...h n (s n )\g n ] 

= B Uo hi(Si) . . . h n -i(S n -i)E Uo [h n (S n )\Gn V a(S\, . 
E„„ hi(Si) . . . h n _i(S'„_i)E I/0 [h n (S n )\Q 

n] | Gn 



(8) 



E vo [/li(5i) . . . hn-l(Sn-l)\Gn] E UQ [h n (S n )\G n ] . 



, h n some bounded 



S n -i)] \ Gr, 
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Moreover, by (1), 

Va(e„- 2 )] | 9 n 

The product hi(Si) . . . h n -i{Sn-i) is G n -i V cr(So, . . . , <5 n _2)-measurable and 

a(e n -2) -L Gn-i V a(5o, . .., 5 n -2). 
Together with (3) [9, page 308], we obtain 

~E Vo [hi(Si) . . . h n (S n -i)\Qn-i V cr(e n _ 2 )] = E„ [hx(Si) . . . h n -i(S n -x)\G n -i] . 
Finally, we have 

E U0 [hi(Si) . . . h n ^i(S n -i)\Q n ] = E„ [hi(Si) . . . h n -i(S n -i)\g n -i\. 
In the light of (8), we obtain 

e„ [/n(50 . . . K(s n )\g n ] = e, [htiSx) . . . h n ^{s n ^)\g n ^\E VQ [h n (s n )\g n ] . 

Thus, a straightforward induction leads to 

n 

B U0 [hxiSx) . . . h n (S n )\g n ] = H B uo [hiiS^lGi] . 

i=l 

Furthermore, taking for j ^ i, hj = 1, yields to 

E H) [hi(Si)\g n ] =E U0 [h l (s i )\g l ]. 

Hence, 

n 

B U0 [h 1 (s 1 )...h n (s n )\g n ] = Y[B V0 [hi(Si)\ g n ]. 

i=l 

Thus, we have 

\Ja(S,) ±(7(50, 

that immediately implies the expected result. The second conditional independence is 
straightforward from (3). □ 

We have also a continuous-time martingale property. This is the one associated to the 
counting process N %+1 . 

Lemma 2.2. For each integer i, the process M' l+1 given by, 

(9) V0 < t < t*(Zi), M i+1 (t) = N i+1 (t) - I \(Zi, u)l {5i+1 > M} du, 

Jo 

is a continuous-time martingale in the filtration (a(Zi) V^' +1 )o< s< (*(^). 
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Proof. Let < s < t < t*(Zi). In order to prove that M 4+1 is a martingale, we have to 
show that 

i-t 



E 



"0 



N l+1 (t) 



o 



\(Zi,u)l {Si+1 > u} du\a(Zi) V J\ 



4+1 



M l+l {s) 



^ E 



"0 



L {s<S i+ i<t} 



\(Zi,u)l {Si+1 > u} du\ a(Zi)VT ; 



i+1 



^ 1 



{S i+ i>s} 



B U0 [l {Sl+1 <t}\ o{Zi)\JT\ 



+11 



(10) 



!{S i+1 >s} 



X(Zi,u)l {Si+1 > u} du\ a{Zi)y Tl 



+i 



First, we shall prove that (10) is equivalent to 



L {S i+ i>s} 



E, [l {Sj+1 < t} \a(Z i )Vo{N i+1 {s))] 



1 {S i+1 >s} E u 



\{Z u u)l {Si+1 > u} du\ a(Zi) Va(N* +1 (s)) 

In the light of Lemma 6.2 of [17], if the following conditions are satisfied, 
{S l+1 > s} G (a(Zi) VJ-f 1 ) n V a(N i+1 (s))^j 



and 



then (10) and (11) are equivalent. The first condition obviously holds. On the other hand, 
as a(N' l+1 (s)) is a sub-er-field of J 7 ]" 1 " 1 , we have 



{S l+1 >s}n (a(Zi) V = {S i+1 >s}n V a(N i+1 (s))) , 



{S i+1 >s}n [<y{Zi)y r s +1 ) D {Si+i >s}n (a{Z t ) V a{N l+ \s)) 



Hence, we only have to prove the reciprocal inclusion, 



{S t+1 >s}D (a{Zi)VJ^ +l ) C {S i+l >s}n (a(Zi) V a(N l+1 (s))). 
Let us consider the A-system (see for instance Definition 1.10 of [ ]) T> given by 

V={ce a(Zi) V F s +1 : {S i+1 > s} n C e {S i+1 > s} n (<r(Zi) V tr(iV i + 1 ( S ))) } , 
and the 7r-system (see Definition 1.1 of [18]) C defined by 

C = {n,{S l+1 <u}n{z i eB},{z l eB} ■. o < u < s,B e B(J5)}. 

We immediately obtain that C C P and er(C) = a{Zi) V Moreover, cr(Zj) V C P 

on the strength of the monotone class theorem (see for example Theorem 1.19 of [18]). From 
the definition of T>, we straightforward deduce the reciprocal inclusion. Consequently, (10) 
and (11) are equivalent. Now, we only have to verify that (11) holds. On the one hand, 
we have 

l {St+1>s } E, [l {Si+1 <t } | a(Zi) \/a(N* +1 (s))] 

= l{S i+ i>*} Pi/&(£i+l ^ t\Zi,Si+i > s) 



L{S 1+1 >s}- 



[s < Si+i < t\Zi) 
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Prom the definitions of / (4) and G (6), we deduce that 

1{S 1+1>S} E, [l {5i+1 < t} | a(Z t ) V a(N i+1 (s))] 



1 {S l+1 >s} 



/* f(Zi,u)du 



G(Z h s) 



On the other hand, 



l{Si +1 >s}E„ 



\(Z h u)l {Si+1 > u] du\ a{Zi) Va(N i+1 (s)) 
!{S i+ i>s} / A(Zj,-u)P^ (5 i+ i > u| Zi,Si+i > s)du 

J s 



{s l+1 >s} / A(Z<,u) 



P^o > u\ Zi) 

Pf ('S'i+l > s | ^i) 



du. 



Thus, since u < t < t*(Zi), 



l{S i+1 >s}E^ 



A(Z 4 ,n)l {5!+1 > M} dn| a(^) Va(iV i+1 ( S )) 
J s * X(Zi,u)G(Zi,u)du 



L {5 i+1 > S }" 



G(Z i>S ) 



l{S i+ l>s} 



G(Zi,s) ■ 

As a consequence, we proved (11) and the expected result. 



□ 



Proposition 2.1 and Lemma 2.2 are prominent for the next results. In addition, the 
reference to the underlying probability measure P^ will be implicit in the text. For the 
sake of readability, we shall write P x instead of P5 . 

3. Discrete state space 

We assume here that the transition kernel Q only charges a finite set which we denotes 
{xi, . . . ,xm}- One may associate to each x\ the deterministic exit time t* = t*(xi). Now, 
one considers that k is fixed. In this section, we shall prove in Theorem 3.1 that the 
multiplicative model is satisfied for estimating the cumulative rate A(x k , •). 

For each integer n, let us introduce the counting process N n (x k , •) by, 

n-l 

(12) Vt > 0, N n (x k ,t) = ^l { 5 I+1 <t}l{z l= x fe }- 
In addition, for any t > 0, we define 

( 13 ) Y n (x k ,t) = J2 1 {s l+1 >t}l{z l =x k }- 



i=Q 



n-l 



i=0 



Theorem 3.1. Let n > 1. The process M n (x k , ■) defined by, 



(14) 



V0 < t < t%, M n (x k ,t) = N n (x k , t) - / X(x k , s)Y n (x k , s)ds 

Jo 
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is a (J 7 ") 0<t<t* -continuous-time martingale under P uo , with, 



n-l 



V0<t<4, F? = Q n v\l F t +1 . 



i=0 



Proof. Let < s < t < tt- Plugging (12) and (13) in (14), we have 



n-l 

i=0 
n-l 

(15) = ^M^( S )l {Zi=Xfc} , 

i=0 

by (9). Thus, we obtain 
n— 1 

E, \, 

i=0 

On the strength of Proposition 2.1, we have 



n— 1 ,.i 

[M n (x k ,t)\^] = £ {E^A^i)!^] - E„ [ y l {Si+1 > u} A(^,n)dn|JT]}l {Zi= 



■i+1 
t 



Together with Proposition 6.6 of [17], we deduce 
E, [M n (x fc ,t)|JT] 

n— 1 ,.f 

= J2 {Vu [N i+1 (t)\Gn VJ] +1 ] - E„ [ / l {5i+1 > u} A(x fc ,n)d U |S„ V J] +1 ]}l {Zi=:Cfe} . 

„•— n •'O 



i=0 

Furthermore, from Proposition 2.1, we have 



P t + 1 1 Sn- 



Thus, in the light of Proposition 6.6 of [17] again, we have 

n-l 

E„ [M n (x k ,t)\F?} = Y,{ E » [N l+1 (t)\o-(Z l )VFl +1 ]l {Zi=Xk} 



i=0 



- B »olj o Ms. l+1 >u}^k,u)du\a(Zi) V F s +l ]l {Zi=Xk] y 

By Lemma 2.2, this yields to 



n-l 



V U0 [M n (x k ,t)\J?] = Y J M* + \s)l {Zt=Xk} . 



i=0 



Finally, together with (15), M n (x k ,-) is, therefore, a martingale. □ 

Theorem 3.1 states that one may estimate the cumulative rate A(x k ,t) with the Nelson- 
Aalen estimator A n (x k ,t) given by 

n— 1 ^ 

A„(x fc , t) = Y^ Y 7— s , ^{s^tyMz^}- 



10 
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One refers the interested reader to [2, 3] or [5] for a general survey on the properties of 
this estimator. 

4. Continuous state space 

The present section is divided into two parts. In the first one, we provide an estimate 
of the cumulative rate A. The second part deals with the estimation of the jump rate A 
by smoothing the estimator of A by kernel methods. 

4.1. Estimation of A. Let us assume that the transition kernel Q is diffuse, that is to 
say, Q does not charge singletons. The previous procedure is ruled out, since for any 
x G E and each integer i, l{z i= x} = almost surely. As a consequence, we shall naturally 
approximate under regularity conditions the jump rate in x, by the jump rate given the 
state is in a neighborhood of x. As mentioned in the introduction, we shall consider the 
counting process N n (A,t) defined for A G B(E) by 

71-1 

N n (A,t) = J2 1 {z i eA}l{s i+1 <ty 

i=0 

We will see (27) that the stochastic intensity of N n (A, t) in a well-chosen filtration is 

n-1 

Yl 1 {Z l eA}±{S l+1 >t}K Z i, t )- 
i=0 

The first results of this section deal with the ergodicity of the underlying Markov chains. 
Their properties are prominent to establish the asymptotic behavior of the stochastic inten- 
sity of N n (A, t) (see Proposition 4.12). Based on these results, we will study in Proposition 
4.16 and Theorem 4.17 the estimation of L(A, t) = f l(A, s)ds, where l(A, t) is an approx- 
imation of the jump rate X(x,t), with x in A. We will deduce from this an estimator of 
the cumulative rate A(x,t) (see Theorem 4.21). An additional difficulty is related to the 
invariant measure of A, which we have to estimate. 

We shall impose some assumptions about both the ergodicity of the Markov chain 
(Z n ) n >o and the characteristics of the process. In the following, v n denotes the distri- 
bution of Z ra , for each integer n. 

Assumption 4.1. There exists a probability measure v such that, for any initial distribu- 
tion uq = 5{ x y, x G E, 

lim \\u n — u\\tv = 0. 

n— >+oo 

This assumption may be directly related to the transition kernel of the Markov chain 
(Z n ) n >o (existence of a Foster- Lyapunov's function or Doeblin's condition for instance). 
We refer the interested reader to [ ] for results about this kind of connection. This 
assumption leads to the following results. 

Proposition 4.2. We have the following statements: 

(1) (Z n ) n >o is v -irreducible. 

(2) (Z n ) n >Q is positive Harris-recurrent and aperiodic. 

(3) v is the unique invariant probability measure of (Z n ) n >Q. 
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Proof. 

(1) Let x £ E and i/q = 5i x \. Then, from Assumption 4.1, 

lim \\Q n (x,-)-u\\ TV = 0. 

Let us consider A £ £>(-£) such that v{A) > 0. Thus, Q n (x,A) > for n large 
enough. In the light of Proposition 4.2.1 of [22], the Markov chain (Z n ) n >o is, 
therefore, z/-ir reducible. 

(2) Recall that we have 

lim \\Q n (x,-)-u\\ TV = 0. 

n— >+oo 

Thus, on the strength of Theorem 4.3.3 of [ I 5], (-^ n )n>o is positive Harris-recurrent 
and aperiodic. 

(3) A positive Harris-recurrent Markov chain admits a unique (up to a multiple con- 
stant) invariant measure (see for instance the introduction of [14]). □ 

Denote by rj n the distribution of the couple (Z n , S n +i), and by /J, z (-) the conditional law 
of S\ given Zq = z. By construction (3), the distribution of S n +l given Z n = z is also given 
by Hz{~)- The following result gives us the probability measure of (Z n , S n +i) according to 
(^z)zgE and u n . 

Lemma 4.3. For each integer n, rj n satisfies, for any A xT £ B(E) (8) S(R + ) 7 

rj n (A x T) = / fi z (ds)v n (dz). 
JAxT 

Proof. This is the disintegration of the measure r\ n according to its marginal distribution 
v n . □ 

We shall see that the sequence (rj n ) n >o converges to the probability measure r\ given by, 
VAxTe B{E) (8) H(R+), i](A x T) = [ fi z (ds)v(dz). 

JAxT 

Lemma 4.4. For any initial distribution i/q = 5{ x y, x £ E, 



lim \\r]n-il\\TV 



0. 



Proof. Let g be a measurable function bounded by 1. According to Lemma 4.3, 



BxR 4 



g(z, s) [rj n (dz x ds) - r](dz x ds)] 



< 



\V n — V\\TVi 



on the strength of Fubini's theorem, where the function h is defined by, 

VzEE, h(z) = / g(z,s)fi z (ds). 

Furthermore, since |/i(z)| < 1 for any z, we have 



ExR 4 



g(z,s)(r] n (dz x ds) - r](dz x ds)) 



< \Wn-v\\TV, 



Thus, by Assumption 4.1, \\rj n — T]\\tv tends to 0. 



□ 
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As a consequence, the Markov chain (Z n , S n +i) n >o has similar properties of the Markov 
chain (Z n ) n >Q given in Proposition 4.2. 

Proposition 4.5. We have the following statements: 

(1) (Z n ,S n+1 ) n >o is rj-irreducible. 

(2) (Z n , S n +i) n >o is positive Harris-recurrent and aperiodic. 

(3) rj is the unique (up to a multiple constant) invariant probability measure of the 
Markov chain (Z n , 5 ri +i) n >o- 

Proof. One may state this result from Lemma 4.4, with the arguments given in the proof 
of Proposition 4.2. □ 

According to the previous discussion, we shall apply the ergodic theorem to the Markov 
chains (Z n ) n >o and (Z n , 5 n+ i) n >o- Now, we impose some assumptions on the characteris- 
tics of the process. 

Assumptions 4.6. 

(1) The jump rate A is uniformly Lipschitz, that is, 

3[A] Lip >0, V£,?eE, Vs>0, |A(£ )S )-A(£,s)| < [A] Lip 

(2) There exists a locally integrable function M : R+ — > R+ such that, 

V£ E E, Vs > 0, A(C,s) < M(s). 

(3) The density f is continuous in time. 

(4) f is bounded. 

(5) The function t* is continuous. 

Under these assumptions, one states some intermediate results about A, t* and G. 
Lemma 4.7. Let A £ B(E) be a relatively compact set such that A n BE = 0. Thus, 

inf t*(£) > 0. 

In this case, one denotes t*(A) = inf t*(0- Furthermore, 

Vt > 0, inf G(£,t) > 0. 
£eA 

Proof. By assumption, t* is continuous. Moreover, for any £ ^ dE, t*(£) > 0. Since A is a 
compact set such that A n dE = 0, we have 



Hence, 



inf t*(f) > 0. 



inft*(0> inft*(0>0. 



For any s, the function A(-, s) is continuous because it is Lipschitz. Furthermore, A(£, •) is 
bounded by M, not depending on ^, and locally integrable. Recall that we have 

G(t,t) = exp(- J\(t,s)ds\ . 
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Thus, by Lebesgue's theorem of continuity under the integral sign, G(-,t) is continuous, 
and satisfies G(£, t) > for any £. Hence, 

inf G(£,t) > inf G(£,i) > 0. 
Both inequalities are, therefore, proved. □ 

Let us introduce the following notation. 

B+ = {A 6 B(E) : 4 relatively compact, u(A) > OandAfl dE = 0}. 
The following lemma states that, for any A £ A is bounded on A x [0, t*(A)[. 
Lemma 4.8. Let A £ B+ , £ G A and < t < t*(A). Thus, 



inf^ A G(£,i*(A))' 
Proof. As / is bounded and G(£, •) is decreasing, we obtain by Lemma 4.7, 



A(£,i) < 



This immediately yields to the expected result. □ 

Let A £ Let us consider for each integer n the continuous-time process Y n (A, ■), 

defined by, 

n-l 

(16) V0 < i < K n (At) = ^l{ Si+1 > i} l{ Zi EA}. 

i=0 

We shall state two lemmas about the asymptotic behavior of Y n . Before, we focus our 
attention on the link between G(z, •) and /%(•), for any z £ A. 

Remark 4.9. Let A £ £>+ anc? z £ A. For any < t < t*(A), we have 

fj, z ([t,+oo[) = P UQ (Si>t\Z = z) 
= P U0 (Si > t\Z = z), 

because t < t*(A) < t*(z). Thus, 

fi z ([t,+oo[) = G(z,t). 

Lemma 4.10. Let A £ B+ and x £ E. Thus, for any < t < t*(A), 
Y n (A,t) 



/ G(z,t)u(dz) P x -a.s. as n — >• +oo. 
J A 



n 

Furthermore, this limit is strictly positive. 

Proof. In the light of Proposition 4.5, the Markov chain (Z n , S' n +i) n >o is positive Harris- 
recurrent and admits rj as its unique invariant probability measure. Thus, using the ergodic 
theorem (see for instance Theorem 17.1.7 of [22]), we have 

Y n (A,t) 



n 



/ ^z([t, +oo[V(dz) P x -a.s. as n — > +oo. 
J A 



14 ROMAIN AZAIS, FRANQOIS DUFOUR, AND ANNE GEGOUT-PETIT 

Furthermore, for any z G A, as t < t*(A) and according to Remark 4.9, 

/i 2 ([t,+oo[) = G(z,t). 

It is a strictly positive number because v{A) > and infg gj 4 G(£, t) > by Lemma 4.7. □ 

Let A G £>j~ and < t < t*(A). Let us introduce the generalized inverse Y n (A, t) + of 
Y n {A,t) by 



if Y n (A,t) = Q, 
else. 



(17) Y n (A,ty 

Y n {A,t) 

Lemma 4.11. Let A G < t < t*(A) and x £ E. Thus, for all integers n, 

(18) Y n (A,t) + < 1 P x -a.s. 
and, as n goes to infinity, 

(19) Y n {A,t) + — ► P r a.s, 

(20) l{Y n (A,t)=o} — > P x -a.5., 



o 



l{y„(A, s )=o} ds — ► ~Px-a.s. 



Proof. Y n (A, t) + is almost surely bounded by 1, since Y n (A,t) takes its values on the 
integers. One immediately obtains the limits (19) and (20), because Y n (A,t)/n almost 
surely admits a strictly positive limit by virtue of Lemma 4.10. Finally, 

limsup / l {Yn ( A ,s)=o} ds < / limsupl { y n(As ) =0 }ds = 0, 

n— >+oo JO JO n— >+oo 

by (20). □ 

In the following proposition, we shall apply the ergodic theorem in order to define, for any 
A G £>+, the function l(A, ■) which is an approximation of the jump rate A(£, •), for £ G A 
(see Lemma 4.18). We also state the continuity of this function. 

Proposition 4.12. Let A G , < t < t*(A) and x G E. Thus, when n goes to infinity, 

(21) Y n {A,t) + ]T \{Zi, t)l{ Zi eA}l{s i+1 >t} -)> KA,t) = P.-** 

The function l(A, •) is continuous on [0,t*(A)[. We especially have 

(22) K t (A)= sup \l(A,s)\ < +oo. 

0<s<< 

Proof. The ergodic theorem (Theorem 17.1.7 of [22]) applied to (Z n , S n +i) n >o leads to 

1 n_1 f 
lim - V A(Zi,t)l {ZieA }l {Si+1 > i} = / \(z,t)fj, z ([t,+oo[)v(dz) P x -a.s. 

n— >+oo n J a 



1=0 



/ X(z,t)G(z,t)u(dz) P x -a.s., 
J A 
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because t < t*(A). Notice that f(z,t) = X(z,t)G(z,t). Thus, 



n-l 

\z) ~P x -a.s. 

i=0 ' ' 

Furthermore, in the light of Lemma 4.10, 



1 n_1 f 

>,— t-rao ib j j± 



lim -K n (A,t)= / G(z,t)u(dz) P x -a.s. 
i->+oo n J a 



Finally, doing the ratio of these two limits leads to the expected convergence. On the 
strength of Lebesgue's theorem of continuity under the integral sign, l(A, •) is a continuous 
function, since / and G are continuous in time and bounded. □ 

Having established the asymptotic behavior of Y n , we focus on continuous-time martin- 
gales. In particular, thanks to Lenglart's inequality for continuous-time martingales, we 
shall estimate, for any A E B„, the functions l(A, •) and L(A, •), where L(A, •) is given by, 

(23) V0 < t < t*(A), L(A,t) = [ l(A,s)ds. 

Jo 

Theorem 4.13. Let A E . For each integer n, the process M n (A, •) defined by, 

n-l 

(24) V0 < t < t*(A), M n (A,t) = Y,M i+ \t)l {z ^ A] , 

8=0 

is a continuous -time martingale in the filtration (Q n V J r t +1 )o<t<t*(A)- 



Proof. Let < s < t < t*(A). Then, 

n— 1 n-l Ti—l 

E U0 [M n (A,t)\Q n V V^ +1 ] =Y J E ^[ Ml+1 ( t ) 1 {z,eA}\GnV V^ +1 ]- 

i=0 i=0 j=0 

Moreover, on the strength of Proposition 2.1, we have 

V Fi J. r t +1 and r t +1 j_ g n . 

Therefore, since a{Zi) is a sub-cr-field of Q n , we have by Corollary 6.8 of [17], 

W P s J_ r t +l ya{Zi) and a(Z { ) V F t +l J_ Q n . 

Thus, as M i+1 (t)l {Zi£A} is cr(Z t ) V J^ +1 -measurable, 

n-l n— 1 

E„[M n (i,t)|g,vV^ +1 ] = E E -o[ Mi+1 (i)l{^^}I^VJ] +1 ] 

i=0 i=0 
n-l 

= ^ E, [M i+1 (t)l {Zi£A} |a(^) V . 

i=0 

Furthermore, with Lemma 2.2, 

E.JM^)!^}!^) V = M i+1 ( S )l {ZiGA} . 



1(5 

Thus, 
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n-1 



n-1 



i=0 



i=0 



By (24), this ensures that M n (A, •) is a martingale. 



□ 



For any A £ let us introduce the counting process N n (A, •), defined for any < t < 
t*(A) by 



n-1 



(25) 



N n (A,t) = Y J l{s l+1 <t}l{z l eA}- 



i=0 



Lemma 4.14. Let A £ B£. For all integers n, the process given for all < s < t*(A) by 

(26) M n (A,s)= f Y n (A,u)+dM n (A,u), 

Jo 

is a martingale whose predictable variation process < M n (A) > satisfies for any x £ E, 
V0 < s < t*(A), < M n (A) > (s) ->■ P x -a.s. as n ^ +oo. 

Proof. By (9), (24) and (25), for any < t < t*(A), one may differently write M n (A,t), 

(27) M n (A,t) = N n (A,t) - Y^l {Si+1 > u} l {ZieA} X{Z h u)du. 

J ° i=0 

In the light of Theorem 4.13, this is a continuous-time martingale. As a consequence, the 
process A n (A, •) given by, 



V0 



„ s n-1 

<s<t*(A),An(A,s)= / Vl {s > u} l {z . 6A} A(Zi,u)d 

Jo *=0 



is the compensator of the counting process N n (A, •). In order to prove that M n (A, •) is a 
martingale, one may only state that 

' 'Y n (A,s) + ) 2 dA n (A,s) 



E 



< +00. 



Recall that A is bounded on the set A x [0, i*(^4)[ on the strength of Lemma 4.8. C denotes 
an upper bound of A on this set. Consequently, 

/ (r n (i, S ) + ) dA n (A,s) = Ms t+1 >u}hz l eA}KZ l ,s)ds 
Jo i=Q Jo 

< f (Y n (A, s ) + yc n j2Ms l+1 > s} l { z^A}ds, 

J ■ n 



Furthermore, by (16) and (17), 

(28) jf (y„(^, S )+) 2 d^ n (,4, S ) < C J*Y n (A,s)+ds. 
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I Y n (A,s) + dA n (A,s) < Ct. 
Jo 



Hence, 



E 



I'D 



Y n (A,s) + ) dA n (A,s) 



< +oo. 



This states that M n (A,-) is a martingale. The predictable variation of M n (A,-) is given 
by, 

VO < s < t*(A), < M n (A) > (s) = J (Y n (A,u) + ydA n (A,u). 
Therefore, by (28), 

VO < s < t*(A), < M n (A) >(s)<C [ Y n {A lU ) + du. 

Jo 

According to Lemma 4.11, Y n (A,-) + is bounded by 1 and for any u, Y n (A, u) + almost 
surely tends to 0. Thus, by Lebesgue's dominated convergence theorem, 



< M n (A) > (s) — ► P x -a.s. when n — > +oo. 
This achieves the proof. 



□ 



We stated this lemma in order to apply Lenglart's inequality to the martingale M n (A, ■). 
A reference about this inequality for continuous-time martingales may be found in [5], 
II. 5. 2.1. Lenglart's inequality. 

Remark 4.15. In the light of Lenglart's inequality, the previous lemma directly induces 
that for any A £ B+, < t < t*{A), and x £ E, 



sup 

0<s<t 



M n (A,s) 



0. 



Let A G By. We propose L n (A,-) as an estimator of the function L(A,-) defined by 
(23). It is given by, 

(29) VO < t < t*(A), L n (A, t)= I Y n (A, s)+dN n {A, s). 

Jo 

L n (A, •) is a Nelson-Aalen type estimator of L(A, ■). The following results are related to 
its asymptotic behavior. We shall see that smoothing this estimator provides an estimator 
of l(A, ■). Before, let us introduce this notation, for each n > 0, 

ct 



(30) 



V0<t<t*{A), L* n {A,t)= [ l{A,s)l 

Jo 



{Y n (A,s)>0} 



ds. 



We recall that Y n (A, •) and its generalized inverse have already been defined by (16) and 
(17). 

Proposition 4.16. Let A £ B+ , < t < t*(A) and x G E. Then, 



sup 

0<s<t 



L n (A, S )-L* n (A,s] 



when n goes to infinity. 
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Proof. The definition of M n (A, s) (26), the expression of M n (A, s) (27) and the definition 
of L n (A,s) (29) yield to 



M n (A,s) = L n (A,s) - / Y n {A,u) + \(Z h u)l {z . eA} l {s > u} du. 

Jo 

Thus, M n (A, s) may be written in the following way. 

M n (A, s) = L n (A, s) - L* n (A, s) - a n (s), 
where the extra-term a n (s) is given by 

a n (s) = / Y n (A,u) + ^2[\(Zi,u) - l(A,u)]l {ZieA} l {Si+1 > u} du. 



Therefore, 



sup 

0<s<t 



L n (A, s) - L* n (A, s) < sup \ M n (A,s)\+ sup |a n (s)|. 



0<s<t 



0<s<t 



We have already stated in Remark 4.15 that sup \M n (A, s)\ tends in probability to 0. As 

0<s<t 

a consequence, we only need to study the limit of sup p n (s) . With (16), we have 



0<s<t 



a n {s)\ < / l{y n ( J 4,n)>o} 



n-l 



Y n (A,u) + X(Zi,u)l {ZieA} l {Si+1 > u} - l(A, 



u 



i=0 



du. 



< \l(A,u)\+C 



The integrated function almost surely converges to on the strength of Proposition 4.12. 
Furthermore, in the light of Lemma 4.8, there exists a real number C > 0, which is an 
upper bound of A on A x [0,i*(^4)[. Hence, for u < t, 

n-l 

Y n (A,u) + ^2\(Z l , M)l{Z iS A}l{5 l+ i>w} ~ l(A,u) 
i=0 

< K t (A) + C, 

where Kt(A) has already been defined by (22). As a consequence, we apply Lebesgue's 
dominated convergence theorem, and we obtain 

lim sup |an('S)| =0 P x -a.s., 

n ^+°°0<s<t 

showing the result. □ 
Theorem 4.17. Let A £ B+ , < t < t*(A) and x £ E. Then, 

sup \L n (A, s) — L(A, s) — ^> as n — ^ +oo. 

0<s<t 

Proof. By the triangle inequality, we have 

\L n {A, s) - L(A, s) | < \L n (A, s) - L* n (A, s) \ + \L* n (A, s) - L(A, s)\. 

In the light of Proposition 4.16, we only need to show that sup < s <( |L*(^4,s) — L{A, s)| 
tends in probability to 0. By (22), (23) and (30), 

sup \L* n (A,s)-L(A,s)\<K t (A) [ l {Yn{Ar)=0} dr, 

0<s<t JO 
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and the bound almost surely converges to by Lemma 4.11. □ 

Let A G By. We have provided an estimator of the function L(A,-) on the interval 
[0, £*(^4)[ (see Theorem 4.17). We shall prove that L(A, •) and the cumulative rate A(£, •), 
defined by (5), are close for any £ G A if A is small enough. In the same way, we state that 
l(A, •), given by (21), and the jump rate A(£, •) are close for any £ G A. 

Lemma 4.18. Let A G B+ , z £ A and < s < t*(A), 

\\(z,s) - l(A,s)\ < [A] diam ,4, 
\A(z, s) — L(A, s)| < s [A] Lip diam A. 



x M I*f<t>')*M 



f A G(Z,s)v(dO 



Proof. First, we have 

\X(z,s) - l(A,s) 



f A G(£,5)v(d0 J A 
< [A] Lip diam^. 

Moreover, integrating the previous result leads to | A(z, s) — L(A, s)| < s [A] Lip diam A. □ 

Notice that we can define and estimate the function L(A, •) only when v{A) is strictly 
positive. Therefore, we need to estimate the indicator function I/^mwo}- F° r this, we 
estimate the quantity v{A) by its empirical version, 

j n— 1 

i=0 

Lemma 4.19. By virtue of the ergodic theorem, v n {A) — > v(A) almost surely. Further- 
more, 

1 {i?„(A)>n-V2} ->■ 1 MA)>o} Px-a-s. when n -> +oo, 

for any x G E. 

Proof. Let us distinguish the cases u(A) > and v{A) = 0. 

(i) If u(A) > 0, u n {A) has an almost sure limit which is strictly positive. Thus, for n 

large enough, u n (A) > n -1 / 2 almost surely, 
(ii) If v{A) = 0, the number of visits in A of the Markov chain (Z n )„>o is almost 
surely finite, because this Markov chain is Harris-recurrent. In this case, the sum 
Y^i=<d !{ZieA} almost surely converges to a finite sum. □ 

In the following remark, we focus on the asymptotic behavior of sup L n (A, s) when v(A) = 

0<s<t 

0. Indeed, we stated that the convergence of the estimator holds only when v(A) > 0. 

Remark 4.20. Let A G B(E) such that An dE = and v(A) = 0. Let < s < t < t*(A) 
and x G E. By (29), we have 

71-1 

L n (A,s) < J2Y n {A,S i+ i) + l {z . eA} P x -a.s. 

i=0 
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Together with (18), we obtain 

n-1 

sup L n (A,s) < V"l{z,eA} Px-a-s- 
o<s<t rr 

— — 2=0 

In addition, the number of visits in A is almost surely finite since v{A) = 0. Thus, 
sup L n (A, s) almost surely tends to a finite sum. 

0<s<t 

For estimating A on K, x [0, t] where /C is a compact subset of E, one considers a thin 
enough partition (A}-) of /C and one estimates A(£, s) by L n (Aj, s), for £ E Aj. 

Theorem 4.21. Lei K be a compact subset of ' E and £ E E. For any e,rj > 0, i/iere exist 
an integer N and a finite partition P = (A k ) o/ /C, suc/i i/iai /or any n > N, for any 
< t < m.m. k f k (A k ), 




where K' is defined by 

K! = (J A fc . 

!/(A fe )>0 



Proof. Let us fix s and x. We have 
|P| ^ 

^L n (A fc ,s)l {Pn(j4fc)> i yl{ xe A k } - Mx,s)l {xelc , } 
k=l 

\p\ ^ \p\ 

= ^2L n (A k ,s)l {MAk)> i } l {xeAk } ~ ^2Mx,s)l {xeAk} l {u{Ak)>0} 

k=l " k=l 

\P\ ^ 

= ^ L n(A k , s)l { ~ n(Ak)> i } l {xeAk} l {u{Ak)=oy 
k=l 
\P\ 

+ {^(^'^{MA^-k} - A (x,s)^jl {xeAk} l {u{Ak)>0} . 
k=l 

Let us denote by I the integer between 1 and \P\ such that x is in A[. We distinguish the 
two cases v(A{) > and v(A{) = 0. By assumption on /C, A\ is a relatively compact set 
such that A~i n dE = 0. 

(i) If k'(Aj) = 0, L n (Ai,s) almost surely and uniformly converges to a finite sum, by 
Remark 4.20. Thus, by Lemma 4.19, 

sup L n (Ai,s)l {V , A> x } ^>0. 



NONPARAMETRIC ESTIMATION OF THE JUMP RATE FOR NHMRP'S 21 
(ii) If v(A[) > 0. We have, by the triangle inequality, 

l| 

+ \L n {A u s)-L(A u s)\ 



\L n (Ai,s)l {9n{Ai)> i } - A(x,s) | < L n (Ai, s)\l {9niAl)>n -i/ 2} 



+ 



L(Ai,s) -A(x,s) 



(a) The first term uniformly tends to in probability, since |l{;? n (A i )>n- 1 / 2 } — M 

most surely tends to by Lemma 4.19, and because L n (Ai, •) uniformly converges 
in probability to L(Ai, •), according to Theorem 4.17. 

(b) The second term uniformly tends to in probability on the strength of Theorem 
4.17. 

(c) The third term is bounded by i[A]z,i p max^ diam A^, according to Lemma 4.18, 
which does not depend on x and is arbitrarily small. 

Since the sum is finite, this achieves the proof. □ 

4.2. Estimation of A. In this part, we focus on smoothing the estimator L n (A, •) of 
L(A, •) in order to provide a consistent estimator of l(A, •) (see Proposition 4.23), and, 
therefore, of A (see Theorem 4.24). Indeed, we shall state another corollary of Proposition 
4.16, which deals with the smoothing of L n (A, •) by some kernel methods. 

Let K be a continuous kernel with support [—1,1]. Let us introduce the following 
notations. For any real number b > and < t < t*{A), we denote, 

1/"* /XL — 

V0 < u < t, l nAt (A,u) = lj Q K {— b — JdL n (A,s). 
This is an estimator of l(A, •) within the interval [0,t]. Furthermore, we denote also, 

V0 < u < t, l* nAt (A,u) = ±J k(^ )dL* n (A,s). 
We first prove the following lemma. 

Lemma 4.22. Let A € B+ , b > and < r < t < t*(A). 

i 2 

sup \l nAt (A,s)-l* bt (A,s)\<-V(K) sup \L n (A,s)-L* n {A,s)\. 

0<s<r 0<s<t 

Proof. Let us denote, 

V0 < s < t, g(s) = L n (A, s) - L* n (A, s). 
Thus, by an integration by parts and since ^(0) = 0, 

K{{s-t)/b)g{t)= f K{{s-u)/b)dg(u)- f g(u-)dK{(s - u) fb) . 
Jo Jo 

We deduce from the triangle inequality, 

b sup \% hbi t(A,s)-l* bt (A,s)\< sup \K((s-t)/b)g(t)\+ sup / g(u-)dK((s-u)/b). 

0<s<r 0<s<r 0<s<rJ0 
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For any v ^ [—1, 1], K(v) = 0. This induces that 

\K((s-t)/b)g(t)\ < sup \g(u)\K((s-t)/b) 



0<u<t 

sup I g 

0<u<t 



(u)\{K{(s-t)/b)-K(v)} 



< sup \g{u)\V{K). 

0<u<t 



Furthermore, 

rt p 
g(u-)&K{(s-u)/b) = lim VVfli) \k((s - s i+1 )/b) - K((s - *)/&)} 

70 max{s i+ i-Si}->0 >- J 

< sup \g(u)\V(K), 

0<u<t 

giving the proof. □ 

Proposition 4.23. Let A G £>+ and < r\ < T2 < t < t*(A). There exists a sequence 
{fin)n>o, which almost surely tends to 0, such that 

sup \l n ,p n ,t(A, s) — l(A,s)\ when n — > +oo, 

ri<s<r2 

for any x € E. 

Proof. By the triangle inequality, we have for any sequence (6 n ) n >o, 

(31) \T n , bn , t (A,s)-l(A,s)\ < |r n>6n , t (il,s)-^ 6n)t (A,s)| + |Z^ 6nit (il,a)-i(As)|- 
We consider the sequence (6 n ) n >o defined by, 

Vn > 0, b n = I sup \L n (A,s) -L* n (A,s)\. 

V 0<s<t 

On the strength of Proposition 4.16, the sequence (6 n )n>o tends in probability to 0, and 
we have 



sup 

0<s<t 



L n (A, s) — L^(A, s) o(b n ) when n — > +oo. 



Finally, according to Lemma 4.22, 

(32) sup |Z ni6ni t(A,s) - Z n)6n)t (As)| — ^ when n ->• +oo. 

ri<s<r2 

Now, we focus on the asymptotic behavior of |Z* b t (A, s) — l(A,s)\. By the change of 
variable s — b n v = u, we have 

rs/b n 

l n,b n ,t( A > s ) = / K (v)l {Yn (A,s-b n v)>o}K A , s - b n v)dv. 

J(s-t)/b n 

As (b n ) n >o tends in probability to 0, there exists a subsequence 

(Pn)n>0 = (b a (n))n>0, 
which almost surely converges to 0. Let 

(33) ill = {a; G f2 : (3 n (uj) — > and T-{Y n (A,r 2 .Ld)=0} ~ > Owhen n — > +oo}. 
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According to foregoing and by (20), ~P x (£li) = 1. Let uj 6 VL\ and N such that, for any 
n> N, 

ri/Pn(u) > 1 and (r 2 - t)//3 n (u) < -1. 
For any n > N, we have 



" > > 1 and 



Thus, 



because the support of .fT is [—1,1]. Hence, 
|C,/^) )t (A^)-Z(A, s )| 

< 



if ( l, ) 1 {y»(As-W")»,w)>o} l (^. s - /3n(w)v)dw, 



(34) + 
We shall prove that the terms 



K{u)(l{A,s - p n {u)u) - l(A,sfjdu 
K(v)(l 



sup 

ri<s<r2 



K(u)(l(A,s- p n (u)u) -l(A,sj)du 



and 



sup 



i K(v) (l{y n (A, s -^( w ) v ,u;)>0} - l) KA s - (3 n (uj)v)dv 
converge to for any w£Oi, We shall begin by the second term. 



(i) Recall that K and l(A, •) are two continuous functions. Let C defined by 

C = K t {A) sup K(v), 
-l<v<l 

where Kt(A) has already been defined by (22). Then, we have 
i K(v) {l{ Yn (A, s -Muj)v,uj)>o} ~ l) l(A, s - p n (u))v)di 



< C 



| 1 {Y„(A, S -/9 n (a;)«,a))>0} ~ 



(35) 



The change of variable u = s — f3 n (u)v yields to 



(36) 



1 {Y n (A,s-f5 n (Lo)v,u 1 )=0} dv < 



< 



1 rs+Pnfa) 



s-/3 n (oj) 



l{y„(A,«,oj)=0} d ' u 



1 /•r2+/3n(w) 



r 2 -/3„(oj) 



l{y„(A,«,oj)=o} d '", 
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because u \— > l{Y n (A,u,ui)=o} is an increasing function. Moreover, by definition of 
Riemann's integral of piecewise-continuous functions, we have when n — > +00, 

rr 2 +/3 n (w) 

1 {Y n (A,u,ui)=0} du ~ Pn(u) 



ir 2 -/3 n (u) 
Thus, when n -4 +00, 



1 {Y n (A,r 2, u>)=0} + 1 {Y n (A,r+,u)=0})- 



(37) 



(38) 



1 



r 2 -/3 n (u>) 



L {y„(A,«,o;)=0} 



1 {y n (A,r^,a;)=0} + 1 {r„(A,r+,o))=0}- 



Futhermore, by definition of fix (see (33)), 



L {Yn(A,r 2 ,w)=0} 



when n — >■ +00. 



Finally, (35), (36), (37) and (38) show that 
-1 



sup 

ri<s<r 2 



K(v 



( V ) ( 1 {Y„( J 4, S - / 8„(u;)«,a;)>0} ~ X ) s ~ /3n(w»du 



tends to for almost all u), since P x (Qi) = 1. 
(ii) By virtue of Lebesgue's dominated convergence theorem, we have for any u € fix, 
fl 

when n — )• +00, 



sup 



K(u)(/(,4,s-/3 n (w)u) -Z(A,s))du 
since /(^4, •) is a continuous function. 



Finally, by (34), when n goes to infinity, 

SU P s ) - *(A «) I -> Pj-fl-s. 

ri<s<r 2 

Consequently, the convergence also holds in probability. Together with (31) and (32), we 
obtain the expected result. □ 

Proposition 4.23 states the existence of a (random) sequence (/3 n )n>o such that the estima- 
tor l n ,i3„,t(A, •) tends to l(A, •), within every compact subset [ri,r2], with < r\ < r<i < t 
and t < t*(A). Nevertheless, we do not obtain an explicit construction of this sequence. 
Furthermore, let us notice that the sequence (f3 n ) n >o depends on t. 

Finally, for any A G £>+, we provide a consistent estimator l n g nt (A, •) of l(A, •) within 
the interval [0,t] for any < t < t*(A). However, we are interested in the estimation of 
the jump rate A. Since A is Lipschitz, if A is small enough, then l(A, •) and A(£, •) are close 
for £ 6 A (see Lemma 4.18). This leads to our main result of convergence. 

Theorem 4.24. Let K be a compact subset of E and £ E E. For any e,rj > 0, there exist 
an integer N and a finite partition P = (A^) of K, such that, for any < t < min). t* (A^) , 
there exists for each k, a sequence (f3 n (Ak)) n >o (depending ont) which almost surely tends 
to 0, such that for any n > N, for any < r\ < r<i < t, 

^ l n,MA k ),t(M,s)l {Vn ( Ak)> i}l{ xeAk } - A(x, s)l {xeK , } >7])<e, 



P^( sup sup 

^ x£Kri<s<r 2 fc=1 

where K 1 is defined by 



K! 



U Ak - 

v(A k )>0 
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Proof. This is a consequence of Proposition 4.23 and Lemma 4.18. The proof is similar to 
the one of Theorem 4.21. □ 

Remark 4.25. If the compact subset K, is close to E, then, for any partition (Aj.) de K,, 
the lower bound ^{A^j is small. In this case, one estimates the jump rate on a great part 
of the state space, but within a small time interval. Conversely, if one chooses a small 
compact subset fC, centered in E, one estimates the jump rate on a small part of the state 
space, but within a larger time interval. 



5. Illustration 

Here we present a short simulation study, in order to illustrate the convergence results 
stated in Theorems 4.21 and 4.24. In this section, we consider a non-homogeneous marked 
renewal process (Xt)t>o defined on the disk T> = {x G R 2 : ||x||2 < 1} arid starting from 
the origin (0, 0). The three characteristics Q, A and t* are given, for any x = (x\, X2) 6 "D, 
by 

• for any AeB(R 2 ), Q(x,A) = ^- jf l v {y) exp ^-i \\y - xg^j dy, 

\xi\ + t 

• for any t > 0, X[x, t) 



1 + ||x|| 2 
• t*(x) = 2+ ||x|| 2 , 

where K x is the normalizing constant. This transition kernel obviously satisfies Doeblin's 
condition. Thus, Assumption 4.1 holds for the embedded chain (Z n ) n >Q. Moreover, the 
cumulative rate A associated to A is given by 

i/ ^ \ X l\t +2 



1 + Wj 2 + 2||s|| 2 

We simulate a long trajectory of the process: the observation of 100000 jumps is available 
for estimating the jump rate A. 

In the following, we focus on the estimation of the cumulative rate A(x, t) and the jump 
rate X(x,t), for x = (0,0) and x = (0.2,0.5). In both cases, we choose to approximate 
X(x,t) by the function l(A x ,t), with A x = {y G R 2 : \\y — x\\% < e} and e = 0.2. Therefore, 
we only may estimate the two functions of interest within an interval smaller than [0,2]. 
In both cases, the number of visits in -A(o,o) an( ^ m ^(0.2,0.5) i s cl° se to 4000 (4176 visits 
in -A(o,o) an( i 4042 visits in ^4(o.2.o.5))- I n addition, the chosen bandwidth j3 n (A x ) can be 
written in the following way, 

MAx) = hjATr' 

where h n (A x ) denotes the (random) number of visits in A x , and a = 1/5. Figures 1 and 
2 are given to illustrate the good behavior of our estimators of A and A. 



6. Concluding remarks 



In the present paper, we have developed an efficient nonparametric method for estimat- 
ing both the cumulative rate and the jump rate for a general class of non-homogeneous 
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FIGURE 1. Estimation of the jump rate X(x,t) (left) and the cumulative 
rate A(x, t) (right) with x = (0, 0) and < t < 1.8. Estimates are drawn in 
solid lines, exact rates are in dashed lines. 




FIGURE 2. Estimation of the jump rate X(x,t) (left) and the cumulative 
rate A(x,t) (right) with x = (0.2,0.5) and < t < 1.8. Estimates are 
drawn in solid lines, exact rates are in dashed lines. 

marked renewal processes. Two inherent difficulties are related to the presence of a de- 
terministic censorship, and the absence of conditions on the state space of the process. 
Furthermore, the proposed estimation procedure needs only one observation of the process 
within a long time interval. In addition, the assumptions which we impose are directly 
connected to the primitive characteristics of the process. 

In this context, we proposed nonpar ametric estimators of the cumulative rate and the 
jump rate, and we proved results of uniform convergence in probability on every compact 
subset. As it is illustrated in Section 5, the numerical behavior of both estimators is 
satisfactory on finite sample size. Furthermore, the method is easy to implement and 
not so time-consuming. Finally, although this paper has an intrinsic interest, it is also 
a keystone for estimating the conditional density of the interarrival times for piecewise- 
deterministic Markov processes (see [6]). 
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